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Abstract — Wireless sensor networks have been increas- 
ingly used for real-time surveillance over large areas. 
In such applications, it is important to support end-to- 
end delay constraints for packet deliveries even when 
the corresponding flows require multi-hop transmissions. 
In addition to delay constraints, each flow of real-time 
surveillance may require some guarantees on throughput 
of packets that meet the delay constraints. Further, as wire- 
less sensor networks are usually deployed in challenging 
environments, it is important to specifically consider the 
effects of unreliable wireless transmissions. 

In this paper, we study the problem of providing end- 
to-end delay guarantees for multi-hop wireless networks. 
We propose a model that jointly considers the end-to-end 
delay constraints and throughput requirements of flows, 
the need for multi-hop transmissions, and the unreliable 
nature of wireless transmissions. We develop a frame- 
work for designing feasibility-optimal policies. We then 
demonstrate the utility of this framework by considering 
two types of systems: one where sensors are equipped 
with full-duplex radios, and the other where sensors 
are equipped with half-duplex radios. When sensors are 
equipped with full-duplex radios, we propose an online 
distributed scheduling policy and proves the policy is 
feasibility-optimal. We also provide a heuristic for systems 
where sensors are equipped with half-duplex radios. We 
show that this heuristic is still feasibility-optimal for some 
topologies. 

Ke3Words-Wireless sensor networks; end-to-end dead- 
line; real-time communications 

I. Introduction 

The advance of wireless sensor networks provides an 
appealing solution for real-time surveillance. In real- 
time surveillance, wireless sensors generate flows of 
surveillance data and deliver them to a sink, which 
makes control decisions based on the data. Examples 
of such applications have been demonstrated in many 
previous work, such as |[T|-|[3|. 

A major challenge for real-time surveillance is to pro- 
vide end-to-end delay guarantees for packet deliveries. 

This material is based upon work partially supported by NSF 
under Contracts CNS-1035378, CCF-0939370, CNS-1035340, and 
CNS-0905397, USARO under Contract Nos. W911NF-08-1-0238 and 
W-911-NF-0710287, and AFOSR under Contract FA9550-09-0121. 



Designing scheduling policies that provide end-to-end 
delay guarantees is difficult due to two reasons. As 
wireless sensor networks may be deployed over a large 
area, some flows may require multi-hop transmissions 
to reach the sink. Further, wireless sensor networks are 
usually deployed in challenging environments, such as 
battlefields, forests, or underwater. Within these envi- 
ronment, it may be impossible to ensure that all wireless 
transmissions can be successfully received. Thus, a de- 
sirable policy needs to explicitly address the unreliable 
nature of wireless transmissions. 

In this paper, we aim to address the above difficulties. 
We measure the performance of each surveillance flow 
by its timely-throughput, defined as the throughput of 
packets that are delivered to the sink on time. We then 
propose a model that characterizes the hard per-packet 
end-to-end delay constraints and timely-throughput re- 
quirements of flows, the routing protocol for multi- 
hop transmissions, and the unreliable wireless channels. 
This model also considers both scenarios where sensors 
are equipped with full-duplex radios and half-duplex 
ones. 

Based on the model, we establish a general frame- 
work for designing scheduling policies. We prove a suf- 
ficient condition for a scheduling policy to he feasibility- 
optimal, that is, to be able to fulfill all timely- throughput 
requirements as long as they are feasible. We show that, 
based on this condition, there is a dynamic program- 
ming approach for designing policies for various types 
of systems. 

We then consider designing online, tractable, and 
distributed scheduling policies. We propose a policy for 
systems where sensors are equipped with full-duplex 
radios. We prove that the proposed policy is feasibility- 
optimal. We also propose a simple heuristic for systems 
where sensors are equipped with half-duplex radios, 
and show that it is feasibility-optimal among certain 
topologies. 

In addition to theoretical studies, we also provide 
simulation results. We compare our proposed policies 
against other policies. Simulation results show that our 



proposed policies achieve significantly better perfor- 
mance than others. 

The rest of the paper is organized as follows. Sec- 
tion [n] summarizes existing work on providing end-to- 
end delay guarantees. Section [ni] formally introduces 
our analytical model. Section |lV| establishes a frame- 
work for designing feasibility-optimal policies. Based 
on the framework, Section |V| proposes a feasibility- 
optimal policy for systems where sensors are equipped 
with full-duplex radios. Section El proposes a heuris- 
tic for systems where sensors are equipped with half- 
duplex radios, and proves that the heuristic is feasibility- 
optimal for some topologies. Section IVIII demonstrates 
our simulation results. Finally, Section IVIIII concludes 
this paper. 

II. Related Work 

Providing end-to-end delay guarantees have been an 
important research topic for various systems. Jayachan- 
dran and Abdelzaher pT) have studied this problem 
for distributed real-time systems where a job needs to 
traverse a number of processors before it is completed, 
and have provided a worst-case analysis for end-to- 
end delays. Hong, Chantem, and Hu [5] have consid- 
ered a similar problem and approached it by assigning 
local deadlines for each processor. Li and Eryilmaz 
ll6J have proposed a scheduling policy that aims to 
meet per-packet delay bounds and timely-throughput 
requirements of flows in wireline networks. However, 
no performance guarantees were provided for their 
scheduling policy. Rodoplu et al [[Til have studied the 
problem of estimating end-to-end delay over multi-hop 
wireless networks. Li et al [8] have proposed using 
expected end-to-end delay for selecting path in wireless 
mesh networks. The expected end-to-end delay takes 
both queuing delay and delay caused by unsuccessful 
wireless transmissions. However, their work only aims at 
minimizing the average end-to-end delays, and cannot 
provide guarantees on per-packet delays. Jayachandran 
and Andrews Q have applied a coordinated EDF sched- 
uler for wireless networks and obtained asymptotic 
bounds on end-to-end delays. Li et al [10] have used 
network calculus to analyze and derive upper-bound 
for end-to-end delays. Li, Li, and Mohapatra fTl] have 
proposed a distributed policy for scheduling packets 
with end-to-end delay guarantees. However, their work 
lacks theoretical guarantees on performance. 

There has also been a lot of work that considers end- 
to-end delay guarantees for wireless sensor networks. 
Jiang, Ravindran, and Cho [121 have studied the real- 
time capacity of wireless sensor networks. They ap- 
proach this problem by decomposing end-to-end delays 
into per-hop delays, and then study the probability for 
meeting each per-hop delay independently. Wang et al 



111311 have used a similar decomposition approach and 
studied the problem of energy saving while providing 
end-to-end delay guarantees. Such decomposition ap- 
proach inevitably leads to suboptimal solutions. Chipara 
et al [14] have proposed a protocol for scheduling real- 
time flows by taking interference among sensors into ac- 
count. Wang et al [11511 have investigated the distribution 
of end-to-end delay in wireless sensor networks. Wang 
et al [16] have formulated the problem of providing 
end-to-end delay guarantees as an optimization prob- 
lem, and have proposed a heuristic for obtaining sub- 
optimal solutions. Li, Shenoy, and Ramamritham [.17J 
have aimed at providing end-to-end delay guarantees 
by exploiting spatial reuse. 

III. System Model 

In this section, we present our model for multi-hop 
wireless sensor networks with end-to-end delay con- 
straints. Our model extends a model proposed in llTSll . 
which only considers the delay constraints of packets 
and unreliability of wireless transmissions in a one-hop 
scenario. 

Consider a sensor network with a set of wireless 
sensors. One of the sensors play the role of the sink. 
Sensors may generate surveillance data that need to 
be delivered to the sink in a timely manner, and they 
may relay data that are generated by other sensors. We 
assume that a routing tree has been constructed by some 
routing protocol for the sensor network. There has been 
a lot of work on constructing routing trees for wireless 
sensor networks, and 111911 provides a survey of these 
routing protocols. In the routing tree, the sink is the 
root, and hence we use r to represent the sink. When 
a sensor n has a data packet, either one generated by 
itself or one that is forwarded to it from other sensors, 
it may forward the data to its parent, denoted by h{n), 
in the routing tree. Figure [T] shows an example of such 
a sensor network. A data packet is said to be delivered 
if it reaches the sink. A sensor may generate multiple 
flows of data. For example, one sensor may generate 
data on both temperature and humidity. We denote the 
set of flows in the wireless sensor network by F, and 
n{f) as the sensor that generates data of flow /. 

We assume that time is slotted and numbered by 

t = 1,2, The length of a time slot is set to be the 

time needed for a sensor to transmit one data packet. 
Time slots are further grouped into intervals, where 
each interval consists of T consecutive time slots in 
(fcT, (k + l)r], for some k. At the beginning of each 
interval, each flow in F obtains some surveillance data 
and generates a data packet. We say that a the data 
packet of flow / is generated at the rj'' time slot in 
each interval, so as to account for the latency caused 
by sensing and data processing. We assume that all 




Figure 1: An example of the system consists of 10 
sensors. In the example, we have h{l) — h{2) — r, 
h{3) = h{A) = 1, hid) 2, etc. 



data packets are delay-constrained, and data packets 
generated in one interval need to be delivered to the 
sink before the end of the interval. If a data packet is 
not delivered before the end of the interval, the packet 
is no longer useful for the sink. In this case, v^fe say 
that the packet expires, and drop the packet from the 
system. Thus, we can guarantee that all data received 
by the sink have delays no larger than T time slots. 

We consider both cases when sensors are equipped 
with full-duplex radios and when they are equipped 
with half-duplex radios. When sensors are equipped 
with full-duplex radios, they can transmit and receive 
data packets simultaneously. We also assume that the 
transmissions of different sensors do not interfere with 
each other by, for example, allocating different sensors 
on different subcarriers in an orthogonal frequency- 
division multiple access (OFDMA) system. A system 
where sensors are equipped with full-duplex radios is 
called a full-duplex system. 

The assumptions made for full-duplex systems may 
exceed current hardware limitations of wireless sensor 
network. Thus, we also consider systems where sensors 
are equipped with half-duplex radios. In such systems, 
sensors cannot transmit and receive data packets si- 
multaneously. That is, when a sensor n transmits, its 
parent h{n) cannot transmit, or the transmission by 
n encounters a collision and the transmission fails. 
Moreover, we assume that a sensor can receive at most 
one transmission in a time slot. That is, if we have 
sensors n and m with h{n) = h{m), then at most one 
of them can transmit in a time slot. Finally, we assume 
that different transmissions do not interfere with each 



other except the two cases discussed above. This can be 
done by, for example, scheduling transmissions that may 
interfere with each other in different channels. A system 
where radios are equipped with half-duplex radios is 
called a half-duplex system. 

We consider the unreliable nature of wireless trans- 
missions. To be more specific, we say that when a 
sensor n transmits a data packet to its parent, h{n), 
h{n) correctly receives the packet with probability p„. 
We also assume that, by implementing ACKs, the sensor 
n has feedback information on whether its transmission 
is correctly received by h{n), and it can retransmit the 
same packet in the case that a previous transmission 
fails. 

As wireless transmissions are unreliable, it may be 
impossible to deliver all data packets to the sink on 
time. Instead, each flow / requires a portion qf of 
packets to be delivered on time. That is, let e/(fc) be 
the indicator function that the data packet of flow / in 
the fc*'' interval is delivered to the sink on time. Each 
flow / then requires that, with probability one, 

liminf^il^ >q.. 

if-foo K 

We call ^i'=i^ti^) (-]^g timely-throughput of flow 
/ up to interval K, and qf as the timely-throughput 
requirement on flow /. 

In this paper, we aim to design scheduling policies 
that fulfills timely-throughput requirements of all flows 
as long as they are strictly feasible. These terms are 
formally defined as follows: 

Definition 1: A system is said to be fulfilled 
by some scheduling policy if, under this policy, 
liminfjt-^oo ^'°=]^^^^''^ > qf with probability one, for 
all flow f £ F. 

Definition 2: A system, either a full-duplex system 
or a half-duplex one, is feasible if there exists some 
scheduling policy that fulfills it. 

Definition 3: A system, either a full-duplex system or 
a half-duplex one, is strictly feasible if qf > for all flows 
/, and there exists some e > such that the system 
is still feasible when each flow / requires a timely- 
throughput of (1 -|- e)qf. 

Definition 4: A scheduling policy is feasibility-optimal 
for full-duplex system, or half-duplex system, if it fulfills 
all strictly feasible full-duplex systems, or all strictly 
feasible half-duplex systems, respectively. 

We limit our discussions on strictly feasible systems 
only to simplify the proof of Theorem [T] in the following 
section. As e can be arbitrarily small, this limitation is 
not restrictive. 



IV. A Framework for Scheduling Policies 



In this section, we describe a sufficient condition 
for a policy to be feasibility-optimal. We then show 
a dynamic program approach that derives feasibility- 
optimal policies by employing this sufficient condition. 
This condition is based on the concept of debt: 

Definition 5: The debt of / in the K*^ interval is 
defined as df{K) := Kqf — J2k=i ^fi^)' where e/(fc) is 
the indicator function that the packet for / in interval 
k is delivered on time. 

It is easy to show that a system is fulfilled under some 
scheduling policy if and only if limsup^^^o^ <^fi^) < q_ 
Based on the concept of debt, we establish a sufficient 
condition for a policy to be feasibility-optimal for full- 
duplex systems or half-duplex systems. The condition 
is similar to the one introduced in [I20L which only 
considers one-hop transmissions, and is based on the 
following theorem: 

Lemma 1 (Telescoping Lemma) : Let L{k) be a non- 
negative Lyapunov function depending only on Tk, 
which denotes the set of all events in the system in the 
first k intervals, i.e., L{k) is adapted to Tu- Suppose 
there exist positive constants i? > 0, 5 > 0, and a 
stochastic process /(fc) also adapted to Tk, such that: 



E[L{k + 1) - L{k)\Fk] < B - 8E[f{k)\Tkl (D 

then limsup^.,^ Y.k=o E[f{k)] < B/S, where E[x] 
is the expected value of x. 

Theorem 1: A scheduling policy is feasibility-optimal 
for full-duplex system, or half-duplex system, if, given 
df{k), it maximizes 

Y,df{k)+E[ef{k + 1)] 



in the {k + 1)*'* interval, for all k, where a;+ := 
max{x, 0}, for all full-duplex systems, or half-duplex 
systems, respectively. 

Proof: Consider a strictly feasible system where flow 
/ requires a timely-throughput of > 0. There exists 
some e > such that this system is fulfilled by some 
stationary randomized scheduling policy, ry", when each 
flow / requires a timely-throughput of (1 + e)g/. Thus, 
under ry", we have E[ef{k)] > (1 -l- e)qf. 



Define a Lyapunov function L{k) :— 5 
Since df{k + 1) = df{k) + Qf — ef{k + 1), we have 

Lik + l) = ^J2('^f{k + l)+f 

<\Y.^df{k)+ + qf-ef{k + l)f 
feF 

T.(dfikrr + E dfiknqj - ef{k + 1)) 

+ Y,{^qj-ef{k + l)f 

<L{k) + E d/(fc)+(g/ - es{k + 1)) + B, (2) 
feF 

for some constant B, as g/ and e/(fc -I- 1) are both 
bounded by 1, for all /. 

As E[ef{k + 1)] > (1 + e)qf under jf, for all /, we 
have, under 77°, 

E[J2dfik)+iqf-ef{k + l))\Tk] 
feF 

= Y,df{k)+{qf-E[ef{k + l)]) 
feF 

= J2 df{k)+qf - E df{k)+E[eiik + 1)] 
feF feF 

<-eJ2df{k)+qf. (3) 

feF 

Let ^Yie policy that maximizes 

'EfeFdf{k)+E[ef{k + 1)]. Under 77™"^, we also 
have 

E[J2 diik)+{qf - etik + 1))|.F,.] < -e 5^ df{k)+qf. 
feF feF 

Thus, by Eq. ([2]), we have, under rj"^"-^^ 

E[L{k + 1) - L{k)\Tk] 

<E[J2 Mk)^iqf - ef{k + mT,] + B 
feF 

<B-eY,df{k)+qf. 
feF 

Thus, by Lemma [U we have 

1 ^ 

limsup E E Eidfik)+qf] < B/e. (4) 

Finally, Lemma 4 in [20] shows that Eq. ([4]) implies that 
limsupj^^pp C^^^^^ ) = 0, for all /, and this system is 
fulfilled by 77""^^. Thus, 77™'^^ is feasibility-optimal. ■ 



A. A Dynamic Programming Approach for Scheduling 
Policies 

We now introduce a dynamic programming approach 
for designing scheduling poHcies that aims at maximvi- 
ingE/eF^/W^-^[e/(fc + l)] in the (fc + l)*'* interval by 
making scheduling decisions for each time slot within 
the interval. We first describe the system evolution 
within an interval by a Markov decision process. In the 
t*'* time slot within the interval, we represent the state 
of the system by t and the position of the packet of 
each flow. We denote the position of the packet of flow 
/ by Cf{t), where Cf{t) ^ n \i n has the packet and 
can transmit it in the i*'' time slot, and c/(t) = </) if 
the packet of / is yet to be generated, as the packet 
of flow / will not be generated until the r^'* time slot 
in the interval. The evolution of c/(t + 1) can then be 
described as follows: c/(i + 1) = «(/) when < + 1 = r/, 
where n{f) is the sensor that generates the packet 
of /; Cf{t + 1) = h{cf{t)) with probability Pcf{t) if 
Cf{t) transmits the packet of / in the t*'* time slot, 
where h{cf{t)) is the parent of Cf{t) in the routing tree 
and Pcf{t) is the channel reliability between Cf{t) and 
h{cf{t)); and Cf{t + 1) = c/(i), otherwise. 

We say that the interval ends when t = T + 1. 
Thus, the packet of / is delivered, and e/(fc + 1) = 1, 
if Cf{T + 1) = r. Let V{t,{cf{t)}) be the value of 
^jg^ d/(fc)+i?[e/(fc+l)] when the state of the system is 
represented by {c/(t)} at the t*'* time slot under some 
policy. By Theorem [H a policy is feasibility-optimal if 
it maximizes {c/(l)}), where {c/(l)} is the state 
of the system at the beginning of the interval. Let 
y"°^(t, {cfit)}) be the maximum value of {c/(i)}). 
We then have the recursive relation: V"^°-^{t, {cf{t)}) = 
ma^aeAit,{cfm)E[V"-'-^it + l,{c/(< + 1)})], where 
A{t,{cf{t)}) is the set of possible schedule decisions 
under the current state. Hence {c/(t)}) can 

be obtained by dynamic programming. Moreover, a 
policy that makes its schedule decisions by choosing 
argmax,e^(t,{,^(,)}) E[V^--{t + 1, {cf{t + 1)})] for all 
states is feasibility-optimal. 

While we can derive feasibility-optimal policies from 
the above approach, this approach may require high 
computation overhead, as the number of states for the 
system is as large as (T + 1){\N\ + 1)1^1. In the fol- 
lowing sections, we demonstrate that there is a simple 
online policy for full-duplex systems. We also introduce 
a heuristic for half-duplex system and show that the 
heuristic is feasibility-optimal under some restrictions. 

V. An Online Scheduling Policy for Full-Duplex 
Systems 

We now introduce an online scheduling policy for full- 
duplex systems. The policy is very simple: in each time 



slot, a sensor n picks the flow that has the largest debt 
among those that it currently holds their packets, and 
transmits its packet. In other words, in each time slot t 
of the (fc + 1)*'* interval, n schedules the packet from 
a,Tgma,Xf,cf{t)=ndf{k). We call this policy the Greedy 
Forwarder. In addition to low complexity, this policy 
is also distributed and does not require a centralized 
scheduler Moreover, as we establish below, this simple 
policy is indeed feasibility-optimal. 

Theorem 2: The Greedy Forwarder is feasibility- 
optimal. 

Proof: By Theorem [U we can show that the Greedy 
Forwarder is feasibility-optimal by showing that it maxi- 
mizes J2feF df{k)'^E[ef{k + l)]. To show this, we prove 
the following two claims by induction on the size of the 
network, I iV I : 

1) The Greedy Forwarder maximizes 
EfeFdfik)+E[efik + l)]. 

2) Suppose a sensor generates packets from flow 
/i,/2,---, where df^{k) > df^{k) > .... Also 
assume that this sensor generates packets at time 
ti < t2 < ■ . . , and the sensor has control over 
which flow among {/i, /2, . . . } is to generate pack- 
ets at time ti,t2,..., respectively. Then, with all 
other conditions fixed, by selecting /i to generate 
its packet at times ti, /2 to generate its packet at 
time t2, etc, J2feF df{k)'^E[ef{k + l)] for the whole 
system is maximized. 

We first discuss the case when |iV| = 1, in which 
the sink r is the only sensor in the system. As there is 
only one sensor in the system, there are no scheduling 
decisions to be made, and hence Claim (1) holds. 
Moreover, a packet of flow / is delivered, and hence 
e/(fc -I- 1) = 1, if it is generated before the T*'* time 
slot. Thus, Claim (2) holds as E/e_F '^/(fc)^-^[e/(fc + 1)] 
is maximized by generating packets in decrement order 
of their debts. 

Assume that both Claim (1) and Claim (2) hold 
for all networks with size |A^| = M. We now show 
that these two claims also hold for all networks with 
|A^| = M + 1. We pick a leaf node, denoted by no, in 
the routing tree. We assume that uq generates packets 
for flows /i,/2,..., with df^{k) > df^{k) > at 
times ti < t2 < . . . , and no has control over which 
flows among {/i, /2, . . . } is to generate packets at times 
ti,t2,..., respectively. We also assume that uses a 
work-conserving policy, i.e., it always schedules a trans- 
mission as long as it holds a packe10. Under this policy, 

no successfully transmits packets at times ii < £2 < 

We note that ii,i2,... are random variables whose 
distributions are determined by the channel reliability 

^Obviously, a policy cannot lose its optimality by making more 
transmissions. Thus, this assumption is not restrictive. 



between uq and h{no). Moreover, we have it > tt, for 
all i, as it is impossible to successfully transmit i packets 
before at least the same amount of packets are gener- 
ated. Note that £i, 4, . . . are not influenced by the order 
of packet generations and scheduling decisions, as each 
transmission made by no is successful with probability 
Pno, regardless which packet is being transmitted. 

Given 1 1 , £2 , ■ • • , "0 can effectively determine which 
packets are to be successfully transmitted at times 
£1 , £2 , • ■ • , by choosing the order of packet generations 
and scheduling decisions. The only restriction for hq is 
that the packet from a flow / cannot be transmitted 
before it is generated. If the packet from a flow / is 
successfully transmitted by no at time t, h{no) receives 
the packet at time t and can transmit the packet starting 
at time t + 1. Thus, this system is equivalent to one 
with no removed, making the size of the network to 
be M, and packets from flows /i , /2 , ■ • ■ are generated 

at sensor h{no) at times £1 + 1,^2 + 1, By the 

induction hypothesis on this system with M sensors, 
^ff^pdf{k)^E[ef{k + 1)] is maximized if the packet 
from flow fi is generated at time U + l, for all i. As no 
can make this happen by choosing flow fi to generate a 
packet at time ti and follow the Greedy Forwarder, both 
Claim (1) and Claim (2) hold when no is included in 
the system with size M + 1. 

By induction on \N\, we have that both claims hold 
for all systems, and hence the Greedy Forwarder is 
feasibility-optimal. ■ 

We close this section by discussing some imple- 
mentation issues of the Greedy Forwarder. As noted 
above, under the Greedy Forwarder, every sensor makes 
scheduling decisions solely based on the packets it 
holds. Still, the Greedy Forwarder requires each sensor 
to have the knowledge of debts for all flows in the 
current interval. In practice, this may be impractical. In 
particular, for a large network, sensors that are far away 
from the sink can only obtain delayed information on 
debts of flows. However, as we will show in Section fVlIl 
when sensors apply the Greedy Forwarder with delayed 
information on debts, the resulting performance can still 
be optimal. This is because, as the net change of debt, 
\df{k -f 1) — df{k)\, is bounded, the difference between 
the delayed information on debt and the actual current 
debt is also bounded for all flows. Therefore, a sensor 
that only has delayed information on debts will make 
similar scheduling decisions as one that has information 
on the current values of debts. 

VI. A Heuristic for Half-Duplex Systems 

In this section, we propose a policy for half-duplex 
systems and show that this policy is feasibility-optimal 
for some particular scenarios. 



Recall that there are two important limitations for 
half-duplex systems. First, as a sensor cannot transmit 
and receive simultaneously, a sensor n cannot transmit 
when its parent, h{n), is also transmitting. Second, a 
sensor can only receive one packet at a time, and hence 
two sensors n and m with h{n) — h{m) cannot transmit 
simultaneously. To address theses challenges, we pro- 
pose a policy, namely, the Closest Sensor First Policy. We 
first define d„(t) := maxj^.c^.(t)=„ In other words, 

dn{t) is the largest debt of flows that n holds at the t*^ 
time slot. If the sensor n does not hold any packets, 
dn{t) is defined to be —00. The Closest Sensor First 
Policy can be described iteratively as follows: First, we 
examine all sensors that are one-hop away from the root 
r, that is, we examine all sensors such that /i(n) = r. 
We then schedule the sensor with the largest d„(t) to 
transmit, and the sensor transmits the packet from the 
flow with the largest debt. Next, we examine sensors 
that are two-hop away from the root, that is, sensors 
with h{h{n)) = r. If h{n) is scheduled to transmit in the 
first step, then ?i cannot transmit. Otherwise, a sensor 
n is scheduled to transmit the packet from the flow 
with the largest debt if d„(t) is the largest among all 
sensors m with ft,(m) — h{n). In the above procedure, 
ties are broken arbitrarily, and we carry the procedure 
iteratively. 

In summary, a sensor n who is 5-hop away from the 
root is scheduled in the 5*'* iteration if: (i) h{n) is 
not scheduled in the previous iteration, and (ii) dn{t) 
is the largest among all m with h{m) = h{n). Fig. [2] 
shows an example that illustrates the Closest Sensor 
First Policy. In the example, we number sensors by their 
respective d„(i). Thus, we have d„(i) = n. In the first 
iteration, sensor 5 is scheduled as dz{t) > d3{t). In the 
second iteration, sensor 2 is scheduled as 1^2 (0 > di{t). 
Note that sensor 4 cannot be scheduled as its parent, 
sensor 5, has already been scheduled. Finally, in the 
third iteration, sensor 7 and sensor 9 are scheduled. 

Next, we show that the Closest Sensor First Policy 
is feasibility-optimal if all flows are generated by the 
same sensor no, i.e., = no, for all /, and each flow 
generates a packet at the beginning of the interval, i.e., 
Tf = 1, for all /. In such a system, only sensors on 
the path between no and r are involved in forwarding 
messages. Thus, we call such a system as a path-topology 
system. 

Theorem 3: The Closest Sensor First Policy is 
feasibility-optimal for path-topology systems. 

Proof: By Theorem [T] we can show that the Clos- 
est Sensor First Policy is feasibility-optimal for path- 
topology systems by establishing that this policy maxi- 
mizes J^r^p df{k)+E[ef{k+l)] in the (fc + 1)*'' interval. 

Let 7„ [v] be the number of transmissions that sensor 
n needs to make to successfully transmit v packets to 




Figure 2: An example that illustrates the Closest Sensor 
First poliq^. 



its parent. Note that this does not imply that sensor n 

successfully transmits v packets at the 7„[i;]*'' time slot 
in the interval, as there are time slots that sensor n 
is not scheduled due to the constraints of half-duplex 
systems. We also note that {^n[v] — 7„[w — 1]) is a geo- 
metric random variable with mean 1/pn, as the channel 
reliability between n and h{n) is p„. In practice, the 
values of {7ri[w]} cannot be obtained at the beginning 
of the interval. We will show that, even when the values 
of jn[v] are given for all n and v, there is no policy 
that can achieve larger ^j^pdj{k)^ef{k + 1) than the 
Closest Sensor First Policy, and hence than the Closest 
Sensor First Policy maximizes Y^f^p '^fi.^)^ ^[^f{^+^)]- 

We order flows so that df-^{k) > df^{k) > Let 

r] and rj* be the Closest Sensor First Policy and an- 
other policy that maximizes Z^jgi? rf/(fc)+-E'[e/(fc + 1)], 
respectively. Further, let 9f. and be the times that 
the packet from flow fi is delivered under rj and rj*, 
respectively. If the packet from flow fi is not delivered 
on time under 77, or 77*, we set Of., or 0^., to be T + 1. 
Thus, under rj, or rj*, we have ef.{k+l) = 1(6'/. < T+1), 
or e/,(fc + 1) = < T + 1), respectively 

By the design of the Closest Sensor First Policy, we 

have 6/1 < 9f^ < Suppose there exists some i 

so that 6*j:^ > 9*f^^^ under r]*. We can modify r]* so 
that whenever it schedules the packet from flow fi, 
it schedules the packet from flow /j+i instead, and 
vice versa. Under this modification, the packet of fi 
is delivered on the (^/.^J*'' time slot, and the packet 
of /i+i is delivered on the (6'}.)*'' time slot. If both 
0*f. and 0*f,_^^ are smaller than T+1, both packets are 
still delivered on time after this modification, and hence 
the value of Y^f^p df{k)^ef{k + 1) is not influenced. If 
both 6*f. and 6*f.^^ are larger than T, neither packets are 
delivered on time after this modification, and the value 
of Yf^F df{k)^ef{k + 1) is not influenced. However, if 
0*f.>T> 0).^^, the packet of /, is delivered on time 



and the packet of /i+i is not after the modification, and 
the value of J2feF '^/(^)^^/(^ + 1) ^i^l decrease, as 
dfi{k) > df._^_^{k), with the modification. In sum, the 
value of rf/(fc)"'"e/(A; + 1) will not decrease with 

the modification. Thus, we can repeat this procedure 
until Of < Of < . . . without decreasing the value of 
j:fepdf{k)+ef{k + l). 

From now on, we assume that 0*f^ < OJ^ < . . . under 
r]*. We claim that, under this assumption. Of, < Oj-^ for 
all i. We prove this claim by induction on the number 
of flows. When there is only one flow in the system, the 
Closest Sensor First Policy schedules a transmission for 
flow 1 in every time slot, and hence Of^ < 0*f^. 

Assume that Of^ < Of. for all i when the system has 
/ flows. We now consider the case when the system 
has I + 1 flows. Under the Closest Sensor First Policy, 
whether the packet of a flow /, with z < J is scheduled is 
not influenced by whether the flow is present in the 
system. Thus, the value of j. is the same as in the case 
when the system only has / flows, for all i < I. We then 
have Of. < 0*f. for all i < / by the induction hypothesis. 
Therefore, we only need to prove that Oj^^^ < 9*jj^^- 
If 0*fj^.^ = T -h 1, i.e., the packet of flow is not 
delivered on time under ry*, then Of^^^ < 0*f^^^ holds. 

Consider the case 0*^-^^^ < T. Suppose that, under rj*, 
there is some time during the interval when the packet 
from flow fi+i is closer to the root than the packet from 
flow /,, for some i. Pick i' to be the smallest number 
so that the packet from flow /j'+i is closer to the root 
than the packet from flow at some time t during 
the interval. Now we can pick ti to be the largest time 
before t such that the packet from flow and that 
from flow fii are held by the same sensor. Such ti exists 
as both packets are held by the sensor that generates all 
packets at the beginning of the interval. We then pick t2 
to be the smallest time after t such that both packets are 
held by the same sensor. Such t2 exists as we assume 
that the packet from flow /j' is delivered earlier than 
the packet from flow /i'+i. Thus, in any time slot in 
{ti,t2), the packet from flow fi'+i is always closer to 
the root than that from flow /j/. Now, we can modify 
7}* for time slots in [^1,^2] so that when it schedules 
i' , it schedules i' + 1 instead, and vice versa. After this 
modification, the packet from flow fii is always closer 
to the root than that from flow during {t\,t2). 
Further, this modification does not influence Of for any 
flow /. We repeat this modification until such i' does 
not exist. From now on, we can assume that, at any 
point of time, the packet from flow fi is not closer to 
the root than the packet from flow fj if j < i. 

We prove that Of,^^ < 0*j^^^ by contradiction. Note 
that after the packet of flow // is delivered, rj, or 77*, 
needs to schedule the packet of flow an addition 
number of (^/j+i - Of,), or (6*}^^^ - 0*f^), times before it 



is delivered, respectively. By the induction hypothesis, 
(^fi < Q*fj - Therefore, if 0/^^^ > 0)^^^, we have 6*/^^^ - 
Ofj> ~^fi' under rj*, there are times that the 
packet from flow is scheduled while it would not 
be schedule under 77. We call these times the inversion 
times and denote them by £i < £2 < • • • < iivi- We 
assume that, among all policies that deliver packets at 
times 6j^,9J^, . . . , rj* is one that has the smallest number 
of inversion times. Moreover, among those policies that 
have the smallest number of inversion times, rf is one 
that maximizes Im- 

At time Im, the sensor Cfj^^{iM) holds the packet 
from flow and schedules it under ?/*, while 

Cfi+i {ih[) would not schedule this packet under rj. There 
are two possibilities: first, the sensor Cfj^^{iM) holds 
another packet, and 77 would schedule it; and second, 
under r/, the sensor Cf,^^{iM) would not transmit, as 
its parent, h{c},^^{iM)), would be scheduled for trans- 
mission. In the first case, under ?/*, the transmission of 
cannot be successful. Otherwise, at time Im + 1, 
the packet of is closer to the root than the other 
packet that Cfj^^{iM) holds, and violates our previ- 
ous assumption. Thus, for this case, we can modify 
?/* so that c/j^i(iAf) schedules the other packet, and 
this modification will not influence the deliver times 
of packets. In this case, there are no inversion times 
at and after time Im after the modification. As this 
modification does not create new inversion times, we 
obtain a policy that has a smaller number of inversion 
times than 77*, which contradicts our assumption in 
the last paragraph. Now consider the second case, that 
is, the sensor c/j^i(tA/) would not be scheduled by 77 
because 77 would schedule its parent for transmission. 
As Im is the largest inversion time, there will be a 
time after such that h{cfj^^{iM)) is scheduled to 
transmit a packet, and the packet from flow is not 
scheduled. We call this time i'. At time i', either sensor 
c/j+i(iM) or h{cfj^^{t]si)) holds the packet from flow 
fi+i- We can modify the schedule so that h{cfj^^{iM)) 
is scheduled for transmission at time iu, instead of 
Cfj^iiiu), and the packet from flow is scheduled 
for transmission at time i' . Note that, by our previous 
assumption, the packet from flow is not closer 

to the sink than any other packets. In other words, 
every sensor that is farther from the sink than the one 
holds the packet from flow does not hold any 

packets. Therefore, this modification will not violate any 
interference constraints of the half-duplex system. This 
modification does not influence the delivery times of 
packets and does not increase the number of inversion 
times. Moreover, after applying the modification, the 
largest inversion time becomes i' , which contradicts 
our assumption that rj* maximizes the largest inversion 



time. 

In summary, we have established that f?/, < 9*^, for 
all flows when there are / + 1 flows in the system. By 
induction, we have 9f- < 9*^, for all flows, for all path- 
topology systems. Therefore, the Closest Sensor First 
Policy is feasibility-optimal for path-topology systems. 

■ 

VII. Simulation Results 

In this section, we present our simulation results. We 
adopt the simulation settings in [17], where each flow 
generates one packet every 20 ms, and it takes 2 ms 
for a sensor to make a transmission. Thus, we set the 
duration of a time slot to be 2 ms, and each interval 
consists of 10 time slots. 

We consider the network topology as shown in Fig. [T] 
For each sensor n, its channel reliability, p„, is randomly 
selected within [0.4, 0.9]. We assume that each of sensor 
3, sensor 5, sensor 6, sensor 7, sensor 8, and sensor 
9 generates two flows. Therefore, there are a total 
number of 12 flows in the system. To better illustrate 
our simulation results, we assume that for each of these 
sensors, one flow requires a timely-throughput of a, and 
the other requires a timely-throughput of /3. We define 
the timely-throughput region of a policy to be the region 
consists of all (a, /3) that can be fulfilled by the policy. 
We can then evaluate the performance of a policy by its 
timely-throughput region. 

For all scenarios, we conduct the simulation for 3000 
intervals, i.e., one minute in the simulation environ- 
ment. A system is said to be fulfilled if, by the end of 
the simulation, the debts are less than 90 for all flows, 
which means the actual timely-throughput that a flow 
has is at least [qj — 0.03). 

We consider both the full-duplex system and half- 
duplex system. For the full-duplex system, we compare 
our proposed policy, the Greedy Forwarder, against two 
other policies. We consider a policy where each sensor 
randomly chooses a packet that it holds to transmit 
in each time slot. The policy is called the Random 
policy. We also consider another policy where sensors 
give priorities to flows with higher timely-throughput 
requirements, and break ties randomly. The policy is 
called the Static Priority policy. 

The simulation results for the full-duplex system 
is shown in Fig. [3j The Greedy Forwarder achieves 
the largest timely-throughput region, as it is indeed 
feasibility-optimal. The performance of the Static Pri- 
ority policy is close to optimal when either a is much 
larger than (3, or vice versa, as it gives higher priorities 
to flows with larger timely-throughput requirements. 
On the other hand, the Static Priority policy inevitably 
starves flows with smaller timely-throughput require- 
ments. Thus, it results in poor performance when a is 
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Figure 3: Simulation results for the full-duplex system. 
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Figure 4: Simulation results for systems where sensors 
only have delayed information on debts. 



close to /3. The performance of the Random policy is 
also far from optimal, as it does not take the timely- 
throughput requirements of flows into account. 

We also investigate the influence on the Greedy For- 
warder when sensors only have delayed information 
on debts of flows. We assume that all sensors other 
than the sink update their information on debts every 
A intervals, and we call A the update period. When a 
sensor n updates its information, it notifies its children 
in the routing tree the information on debts that it 
currently has, and receives an updated information from 
its parent. Thus, for a sensor that is g-hop away from 
the sink, the information on debts that it has may be 
\ X g intervals old. We consider three scenarios: one 
where all sensors have knowledge of the current debts 
of flows, one where the update period is 100 intervals, 
i.e., 2 seconds, and one where the update period is 
200 intervals. Simulation results are presented in Fig. 
131 It can be shown that even when sensors update their 
information on debts as infrequent as once every four 
seconds, the performance of the Greedy Forwarder is 
still close to optimal. 

Next we consider the half-duplex system. We consider 
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Figure 5: Simulation results for the half-duplex system. 

a policy that, in each time slot, randomly selects a 
maximal set of sensors who can transmit simultaneously 
among those that hold some packets. Each selected 
sensor then randomly selects a packet to transmit. We 
call this policy the Random policy. We also consider 
a policy that first sorts all undelivered packets in de- 
scending order of the timely-throughput requirements 
of their associated flows. The policy then greedily selects 
a maximal subset of packets so that they can be trans- 
mitted simultaneously. This policy is called the Static 
Priority policy. Finally, we consider the Closest Sensor 
First policy. 

The simulation results of the half-duplex system is 
shown in Fig. [5j The Closest Sensor First policy achieves 
the largest timely-throughput region. A somewhat sur- 
prising result is that both the Random policy and the 
Static Priority policy have very poor performance. The 
Rand policy fails to fulfill the system even when we 
set {a, 13) = (0,0.05), and hence its timely-throughput 
region does not appear in Fig. [5j The reason for this 
behavior is because there are interference constraints 
for half-duplex systems, which limit the number of 
sensors that can transmit simultaneously. Thus, it is 
important to take the network topologies into account 
in order to deliver packets on time. 

Finally, we consider a half-duplex path-topology sys- 
tem with six sensors and six flows, as depicted in 
Fig. [6l All six flows are generated by sensor 5. Three 
of the flows require a timely-throughput of a, while 
the other three flows require a timely-throughput of 
/3. The simulation results are shown in Fig. [71 The 
Closest Sensor First policy achieves the largest timely- 
throughput region. Moreover, both the Static Priority 
policy and the Random policy fail to fulfill the system 
even when we set {a, (3) — (0,0.05). 

VIII. Concluding Remarks 

We have investigated the problem of providing hard 
per-packet delay guarantees for multi-hop wireless sen- 
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Figure 6: The network topology for the half-duplex 
path-topology system. 
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Figure 7: Simulation results for the half-duplex path- 
topology system. 

sor networks. We have proposed an analj^ical model 
that jointly considers the hard delay guarantees of 
packets, the multi-hop routing tree of the network, 
the timely-throughput requirements of flows, and the 
unreliable nature of wireless transmissions. The model 
can be applied for both full-duplex systems and half- 
duplex systems. We have then introduced a framework 
for designing feasibility-optimal scheduling policies for 
different types of systems. Based on this framework, we 
have proposed a distributed scheduling policy for full- 
duplex systems and proved that this policy is feasibility- 
optimal. We have also proposed a heuristic for half- 
duplex systems. We have proved that this heuristic is 
feasibility-optimal for all path-topology systems. Simu- 
lation results have suggested that our proposed policies 
achieve much better performance than other policies. 
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